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1 Introduction 



1.1 General overview 

Since fifteen years non-linear flatness-based control (Fliess, 
Levine, Martin & Rouchon (1995, 1999)) has been quite 
effective in many concrete and industrial applications (sec 
also Lamnabhi-Lagarrigue & Rouchon (2002b); Rudolph 
(2003); Sira-Ramirez & Agrawal (2004)). On the other 
hand, most of the problems pertaining to non-linear state 
estimation, and to related topics, like 

• parametric estimation, 

• fault diagnosis and fault tolerant control, 

• perturbation attenuation, 

remain largely open in spite of a huge literature^. This 
paper aims at providing simple and effective design 
methods for such questions. This is made possible by the 
following facts: 

According to the definition given by Diop & Fliess 
(1991a, b), a non-linear input-output system is observable 
if, and only if, any system variable, a state variable for 
instance, is a differential funetion of the control and 
output variables, i.e., a function of those variables and 
their derivatives up to some finite order. This definition 
is easily generalized to parametric identifiability and 
fault isolability. We will say more generally that an 
unknown quantity may be determined if, and only if, it 
is expressible as a differential function of the control and 
output variables. 

It follows from this conceptually simple and natural view- 
point that non-linear estimation boils down to numerical 
differentiation, i.e., to the derivatives estimations of noisy 
time signals^. This classic ill-poscd mathematical prob- 
lem has been already attacked by numerous means^. We 
follow here another thread, which started in Fliess & Sira- 
Ramfrez (2004b) and Fliess, Join, Mboup & Sira-Ramfrez 
(2004, 2005): derivatives estimates are obtained via inte- 
grations. This is the explanation of the quite provocative 

^See, e.g., the surveys and encyclopedia edited by Astrom, Blanke, 
Isidori, Schaufclbcrgcr & Sanz (2001); Lamnabhi-Lagarrigue & Rou- 
chon (2002a,b); Levinc (1996); Menini, Zaccarian & Abdallah (2006); 
Nijmeijer & Fossen (1999); Zinober & Owens (2002), and the refer- 
ences therein. 

^Thc origin of flatncss-bascd control may also be traced back to 
a fresh look at controllability (Fliess (2000)). 

■^For some recent references in the control literature, see, e.g., 
Braci & Diop (2001); BusvcUe & Gauthicr (2003); Chitour (2002); 
Dabroom & Khalil (1999); Diop, Fromion & Grizzle (2001); Diop, 
Grizzle & Chaplais (2000); Diop, Grizzle, Moraal & Stefanopoulou 
(1994); Duncan, Madl & Pasik-Duncan (1996); Ibrir (2003, 2004); 
Ibrir & Diop (2004); Kelly, Ortega, Ailon & Loria (1994); Levant 
(1998, 2003); Su, Zheng, Mueller & Duan (2006). The literature on 
numerical differentiation might be even larger in signal processing 
and in other fields of engineering and applied mathematics. 
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title of this paper* where non-linear asymptotic estimators 
are replaced by differentiators, which are easy to imple- 
ment^. 

Remark 1.1. This approach to non-linear estimation 
should he regarded as an extension of techniques for linear 

closed-loop parametric estimation (Fliess & Sira-Ramirez 
(2003, 2007)). Those techniques gave as a byproduct lin- 
ear closed-loop fault diagnosis (Fliess, Join & Sira-Ramirez 
(2004)), and linear state reconstructors (Fliess & Sira- 
Ramirez (2004a)), which offer a promising alternative to 
linear asymptotic observers and to Kalman's filtering. 

1.2 Numerical differentiation: a short summary 
of our approach 

Let us start with the first degree polynomial time func- 
tion pi{t) = ao + o,it, t >0, flo, fli G M. Rewrite thanks to 
classic operational calculus (see, e.g., Yosida (1984)) pi as 
fi = ^ + fj-. Multiply both sides by s^: 

s^Pi = aos -I- ai (1) 

Take the derivative of both sides with respect to s, which 
corresponds in the time domain to the multiplication by 
-t: 

s'^ + 2sPi=ao (2) 

The coefficients ao, ai are obtained via the triangular sys- 
tem of equations (l)-(2). We get rid of the time derivatives, 
i.e., of .sPi, s^Pi, and s^^^, by multiplying both sides of 
Equations (l)-(2) by s~", n > 2. The corresponding iter- 
ated time integrals are low pass filters which attenuate the 
corrupting noises, which are viewed as highly fluctuating 
phenomena (cf. Fliess (2006)). A quite short time window 
is sufficient for obtaining accurate values of ao, ai. 

The extension to polynomial functions of higher degree 
is straightforward. For derivatives estimates up to some 
finite order of a given smooth function / : [0,-|-oo) K, 
take a suitable truncated Taylor expansion around a given 
time instant to, and apply the previous computations. Re- 
setting and utilizing sliding time windows permit to es- 
timate derivatives of various orders at any sampled time 
instant. 

Remark 1.2. Note that our differentiators are not of 
asymptotic nature, and do not require any statistical knowl- 
edge of the corrupting noises. Those two fundamental fea- 
tures remain therefore valid for our non-linear estimation^. 
This is a change of paradigms when compared to most of 
today's approaches^ . 

*Therc are of course situations, for instance with a very strong 
corrupting noise, where the present state of our techniques may be 
insufficient. Sec also Remark 2.5. 

'Other authors like Slotine (1991) had already noticed that 
"good" numerical differentiators would greatly simplify control syn- 
thesis. 

''They are also valid for the linear estimation questions listed in 
Remark 1.1. 

''See, e.g., Schweppe (1973); Jaulin, Kiefer, Didrit & Walter 



1.3 Analysis and organization of our paper 

Our paper is organized as follows. Section 2 deals with the 
differential algebraic setting for nonlinear systems, which 
was introduced in Fliess (1989, 1990). When compared 
to those expositions and to other ones like Fliess, Levine, 
Martin & Rouchon (1995); Delaleau (2002); Rudolph 

(2003) ; Sira- Ramirez & Agrawal (2004), the novelty lies 
in the two following points: 

1. The definitions of observability and parametric iden- 
tifiability are borrowed from Diop & Fliess (1991a, b). 

2. We provide simple and natural definitions related to 
non-linear diagnosis such as detectability, isolability, 
parity equations, and residuals, which are straightfor- 
ward extensions of the module-theoretic approach in 
Fliess, Join & Sira-Ramirez (2004) for linear systems. 

The main reason if not the only one for utilizing differential 

algebra is the absolute necessity of considering derivatives 
of arbitrary order of the system variables. Note that this 
could have been also achieved with the differential geo- 
metric language of infinite order prolongations (see, e.g., 
Fhess, Levine, Martin & Rouchon (1997, 1999))^. 

Section 3 details Subsection 1.2 on numerical differenti- 
ation. 

Illustrations are provided by several academic examples^ 
and their numerical simulations^'^ which we wrote in a such 
a style that they are easy to grasp without understanding 
the algebraic subtleties of Section 2: 

1. Section 4 is adapting a paper by Fan & Arcak (2003) 
on a non-linear observer. We only need for closing the 

loop derivatives of the output signal. We neverthe- 
less present also a state reconstructor of an important 
physical variable. 

2. Closed- loop parametric identification is achieved in 
Section 5. 

(2001), and the references therein, for other non-statistical ap- 
proaches. 

*The choice between the algebraic and geometric languages is a 
delicate matter. The formalism of differential algebra is perhaps sup- 
pler and more elegant, whereas infinite prolongations permit to take 
advantage of the integration of partial differential equations. This 
last point plays a crucial role in the theoretical study of flatness (see, 
e.g., Chetverikov (2004); Martin & Rouchon (1994, 1995); van Nieuw- 
stadt, Rathinam & Murray (1998); Pomet (1997); Sastry (1999), and 
the references therein) but seems to be unimportant here. Differential 
algebra on the other hand permitted to introduce quasi-static state 
feedbacks (Delaleau & Pcrcira da Silva (1998a, b)), which arc quite 
helpful in feedback synthesis (sec also Delaleau & Rudolph (1998); 
Rudolph & Delaleau (1998)). The connection of differential algebra 
with constructive and computer algebra might be useful in control 
(see, e.g., Diop (1991, 1992); Glad (2006), and the references therein). 

^Tliesc examples happen to be flat, although our estimation tech- 
niques arc not at all restricted to such systems. We could have ex- 
amined as well uncontrolled systems and/or non-fiat systems. The 
control of non-flat systems, which is much more delicate (see, e.g., 
Fliess, Levine, Martin & Rouchon (1995); Sira-Rami'rez & Agrawal 

(2004) , and the references therein), is beyond the scope of this article. 
^''Any interested reader may ask C. Join for the corresponding 

computer programs (Cedric. Join®craii.uhp-nancy.fr). 



3. Section 6 deals with closed-loop fault diagnosis and 
fault tolerant control. 

4. Perturbation attenuation is presented in Section 7, via 
linear and non-linear case-studies. 

We end with a brief conclusion. First drafts of various 
parts of this paper were presented in Fliess & Sira- Ramirez 
(2004b); Fliess, Join & Sira-Ramfrez (2005). 



2 Differential algebra 



Commutative algebra, which is mainly concerned with 
the study of commutative rings and fields, provides the 
right tools for understanding algebraic equations (see, e.g., 
Hartshorne (1977); Eisenbud (1995)). Differential alge- 
bra, which was mainly founded by Ritt (1950) and Kolchin 
(1973), extends to differential equations concepts and re- 
sults from commutative algebra^^. 

2.1 Basic definitions 

A differential ring R, or, more precisely, an ordinary dif- 
ferential ring, (see, e.g., Kolchin (1973) and Chambert- 
Loir (2005)) will be here a commutative ring^^ which is 
equipped with a single derivation : R ^ R such that, 
for any a,b & R, 

• iia + b) = a-i-b, 

• ^{ab) = db-\-ab. 

where ^ = a, ^ = a^"\ v >Q. k differential field, or, 
more precisely, an ordinary differential field, is a differen- 
tial ring which is a field. A constant of R is an element 
c G R such that c = 0. A (differential) ring (resp. field) 
of constants is a differential ring (resp. field) which only 
contains constants. The set of all constant elements of R 
is a subring (resp. subfield), which is called the subring 
(vesp. sub field) of constants. 

A differential ring (resp. field) extension is given by two 
differential rings (resp. fields) R2, such that Ri C R2, 
and qthc derivation of Ri is the restriction to Ri of the 
derivation of i?2- 

Notation Let 5 be a subset of R2. Write Ri{S} (resp. 
Ri{S)) the differential subring (resp. subfield) of i?2 gen- 
erated by Ri and S. 

Notation Let A; be a differential field and X = {xi,\l e /} 
a set of differential indeterminates, i.e., of indetcrminates 
and their derivatives of any order. Write k{X} the differ- 
ential ring of differential polynomials, i.e., of polynomials 
belonging to G 7; v^>Q\. Any differential poly- 

nomial is of the form X]fi„ito "^nimitcC^'^'^)"^' ' c G k. 
Notation If Ri and R2 are differential fields, the corre- 
sponding field extension is often written R2/R1. 

^^Algebraic equations are differential equations of order 0. 
12 See, e.g., Atiyah & Macdonald (1969); Chambert-Loir (2005) for 
basic notions in commutative algebra. 



A differential ideal 3 of i? is an ideal which is also a 
differential subring. It is said to be prime if, and only if, J 
is prime in the usual sense. 

2.2 Field extensions 

All fields are assumed to be of characteristic zero. Assume 
also that the differential field extension K/ k is finitely gen- 
erated, i.e., there exists a finite subset S C K such that 
K = k{S). An element a of if is said to be differentially 
algebraic over k if, and only if, it satisfies an algebraic dif- 
ferential equation with coefficients in k: there exists a non- 
zero polynomial P over k, in several indeterminates, such 
that P(a, d, . . . , a^''^) = 0. It is said to be differentially 
transcendental over k if, and only if, it is not differentially 
algebraic. The extension K/k is said to be differentially 
algebraic if, and only if, any element of K is differentially 
algebraic over k. An extension which is not differentially 
algebraic is said to be differentially transcendental. 
The following result is playing an important role: 

Proposition 2.1. The extension K/k is differentially al- 
gebraic if, and only if, its transcendence degree is finite. 

A set {^t I i e /} of elements in K is said to be dif- 
ferentially algebraically independent over k if, and only if, 
the set {^i'^'' I t G /, > 0} of derivatives of any order is 
algebraically independent over k. If a set is not differen- 
tially algebraically independent over k, it is differentially 
algebraically dependent over k. An independent set which 
is maximal with respect to inclusion is called a differential 
transcendence basis. The cardinalities, i.e., the numbers of 
elements, of two such bases are equal. This cardinality is 
the differential transcendence degree of the extension K/k; 
it is written diff tr deg {K/k). Note that this degree is 
if, and only if, K/k is differentially algebraic. 

2.3 Kahler differentials 

Kdhler differentials (see, e.g., Hartshorne (1977); Eisenbud 
(1995)) provide a kind of analogue of infinitesimal calcu- 
lus in commutative algebra. They have been extended to 
differential algebra by Johnson (1969). Consider again the 
extension K/k. Denote by 

• K[-j^] the set of linear differential operators 

S finite G K, which is a left and right princi- 

pal ideal ring (see, e.g., McConnell & Robson (2000)); 

• ftx/k the left isr[J^]-module of Kahler differentials of 
the extension K/k; 

• dK/k^ e ^K/k the (Kahler) differential of x £ K. 
Proposition 2.2. The next two properties are equivalent: 

1. The set {x^ \ i € 1} d K is differentially algebraically 
dependent (resp. independent) over k. 

2. The set {d^/kX^ \ l £ 1} is K[^]-linearly dependent 
(resp. independent). 



The next corollary is a direct consequence from Proposi- 
tions 2.1 and 2.2. 

Corollary 2.1. The module 0,x/k satisfies the following 
properties: 

• The rank^'^ of ^x/k is equal to the differential tran- 
scendence degree of K/k. 

• VLx/k is torsion^'* if, and only if, K/k is differentially 
algebraic. 

• dimif (fix/fe) = tr deg{L/K). It is therefore finite if, 
and only if, L/K is differentially algebraic. 

• ^K/k = {0} if o-nd only if, L/K is algebraic. 

2.4 Nonlinecir systems 
2.4.1 Generalities 

Let k be a given differential gromid field. A (nonlinear) 
(input- output) system is a finitely generated differential ex- 
tension K/k. Set K = k{S,'W,Tz) where 

1. S* is a finite set of system variables, which contains the 
sets u = (ui, . . . , Urn) and y = (yi, . . . , yp) of control 
and output variables, 

2. W = {wi,...,Wg} denotes the fault variables, 

3. TT = (tti, . . . , TTi-) denotes the perturbation, or distur- 
bance, variables. 

They satisfy the following properties: 

• The control, fault and perturbation variables do not 
"interact", i.e., the differential extensions k{u)/k, 
k(W)/k and k{Tz)/k are linearly disjoint^^. 

• The control (resp. fault) variables are assumed to be 
independent, i.e., u (resp. W) is a differential tran- 
scendence basis oik{u)/k (resp. k{'W)/k). 

• The extension K/k{u,'W,TT) is differentially alge- 
braic. 

• Assume that the differential ideal (tt) C k{S,TT,'W} 
generated by tt is prime^^. Write 

^|^nom^^nom| ^ k{S, TV ,W} / (tt) 

the quotient differential ring, where the nominal sys- 
tem and fault variables W"^"™ are the canon- 
ical images of S, W. To those nominal vari- 
ables corresponds the nominal system)"^ K^°™/k, 

i^^Scc, e.g., McConncU & Robson (2000). 
^"'Scc, e.g., McConncU & Robson (2000). 
I'^'Scc, e.g., Eisenbud (1995). 

^''Any reader with a good algebraic background will notice a 
connection with the notion of differential specialization (see, e.g., 
Kolchin (1973)). 

^'^Let us explain those algebraic manipulations in plain words. Ig- 
noring the perturbation variables in the original system yields the 
nominal system. 



where ii"""™ = ^(5"°™, W"°™) is the quotient 
field of fc{5'"°'",W"°'"}, which is an integral do- 
main, i.e., without zero divisors. The extension 
/f"°™/fc(w"°™, W"™) is differentially algebraic. 

• Assume as above that the differential ideal (W"°™) C 
^l^nom Yvr-^omi generated by W""" is prime. Write 

where the pure system variables are the canon- 

ical images of 5'"°™. To those pure variables corre- 
sponds the pure system}^ where K'^^'^^ = 
kiSP""'") is the quotient field of fc{5P"'''}. The exten- 
sion ii'P"''^/A;(uP"'''') is differentially algebraic. 

Remark 2.1. We make moreover the following 
natural assumptions: diff tr deg (fc(MP"'''')/fc) = 
diff tr deg = diff tr deg (A;(M)/fc) = m, 

diff tr deg W"°'")/fc) = diff tr deg {k{ W}/k) = q 

Remark 2.2. Remember that differential algebra consid- 
ers algebraic differential equations, i.e., differential equa- 
tions which only contain polynomial functions of the vari- 
ables and their derivatives up to some finite order. This is 
of course not always the case in practice. In the example 
of Section 4, for instance, appears the transcendental func- 
tion sinOi. As already noted in Fliess, Levine, Martin & 
Rouchon (1995), we recover algebraic differential equations 
by introducing tan ^ . 

2.4.2 State-variable representation 

We know, from proposition 2.1, that the transcendence 
degree of the extension K/k{u, W, tt) is finite, say n. Let 
X — {xi, . . . , a;„) be a transcendence basis. Any derivative 
Xi, i = 1, . . . , n, and any output variable yj, j = 1, . . . ,p, 
are algebraically dependent over k{u, W, tt) on x: 



Ai{xi,x) = i- 
Bj{yj,x) = j 



1, 



,n 



(3) 



whore Ai G k{u,'W,n)[xi,x], Bj E k{u,'W,7r)[yj,x], 
i.e., the coefficients of the polynomials Ai, Bj depend on 
the control, fault and perturbation variables and on their 
derivatives up to some finite order. 

Eq. (3) becomes for the nominal system 



^nom^^nom ^nom^ 



i = l,. 

J = l,. 



■ 7 ^nom ^ ^ 



(4) 



where Af""^ G A;(u"°'^, W"°'^)[x^°'",a;"°'^], B^""" 



i.e., the coefficients of 

and _B"°™ depend on the nominal control and fault vari- 
ables and their derivatives and no more on the perturba- 
tion variables and their derivatives. 
We get for the pure system 



^purc^^purc^pure) ^0 i = l,...,np 



(5) 



^^Ignoring as above the fault variables in the nominal system yields 
the pure system. 



where A^"""" 

fc^upurc^[ypure^ 
Tpurc 



X 



e 

pure] 



pure 



I.e. 



the coefficients of Af" 



and 5? depend only on the pure control variables and 
their derivatives. 

Remark 2.3. Two main differences, which are confirmed 
by concrete examples (see, e.g., Fliess & Easier (1990); 
Fliess, Levine & Rouchon (1993)), can be made with the 
usual state-variable representation 

X = F{x, u) 

y = H{x) 

1. The representations (3), (4), (5) are implicit. 

2. The derivatives of the control variables in the equa- 
tions of the dynamics cannot be in general removed 
(see Delaleau & Respondek (1995)). 

2.5 Variational system^^ 

Call ^K/k (resp. ri/fnom/^., flj^puiB//.) the variational, or 
linearized, system (resp. nominal system, pure system) of 
system K/k. Proposition 2.2 yields for pure systems 



A 



V <^KP-vfcyP"" / 



B 



f dfCpuTe/l-U'l^'^^ ^ 
\ dKVU.e/kUP^'^^ J 



(6) 



where 

• A€ K[f^]P''P is of full rank, 

• Be ii'[^]P><™. 

The pure transfer matrix?^ is the matrix A~^B € 
K{sY^'^, where K{s), s = -^,18 the skew quotient field^^ 
ofKii]. 

2.6 Differential fiatness^^ 

The system K/k is said to be (differentially) flat if, and 
only if, the pure system K^^'^'^/k is (differentially) flat 
(Fliess, Levine, Martin & Rouchon (1995)): the algebraic 
closure KP"''" of i^P^''<= is equal to the algebraic closure 
of a purely differentially transcendental extension of k. 
It means in other words that there exists a flnite subset 



• 2l 



, . . . , z^'^'^ are differentially algebraically inde- 



pendent over k. 



^purc 



arc algebraic over K^^ 



^■'Scc Fliess, Levine, Martin & Rouchon (1995) for more details. 

"^"See Fliess (1994) for more details on transfer matrices of time- 
varying linear systems, and, more generally, Fliess, Join &; Sira- 
Ramfrez (2004), Bourles (2006) for the module-theoretic approach 
to linear systems. 

^^Sec, e.g., McConnell & Robson (2000). 

■^■^For more details see Fliess, Levine, Martin & Rouchon (1995); 
Rudolph (2003); Sira-Rami'rez & Agrawal (2004). 



any pure system variable is algebraic over 



^puro ^ (pure) flat, or linearizing, output. For a flat 
dynamics, it is known that tlw^ mimbcr m of its elements 
is equal to the number of independent control variables. 



2.7 Observability and identifiability 

Take a system K/k with control u and output y. 



Remark 2.5. In the case of algebraic determinability, 

the corresponding algebraic equation might possess several 
roots which are not easily discriminated (see, e.g., Li, Ghi- 
asson, Bodson & Tolbert (2006) for a concrete example). 

Remark 2.6. See Sedoglavic (2002) and Ollivier & Se- 
doglavic (2002) for efficient algorithms in order to test ob- 
servability and identifiability. Those algorithms may cer- 
tainly be extended to determinable variables and to various 
questions related to fault diagnosis in Section 2.8. 



2.7.1 Observability 

According to Diop & Fliess (1991a, b) (see also Diop 
(2002)), system K/k is said to be observable if, and only 
if, the extension /s:P"'^7fc(wP"'-^ yP""-**) is algebraic. 

Remark 2.4. This new definitior?^ of observability is 

"roughly" equivalent (see Diop & Fliess (1991a, b) for de- 
tails^*) to its usual differential geometric counterpart due 
to Hermann & Krener (1977) (see also Conte, Moog & 
Perdon (1999); Gauthier & Kupka (2001); Isidori (1995); 
Nijmeijer & van der Schaft (1990); Sontag (1998)). 
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2.7.2 Identifiable parameters 

Set k = ko{&), where ko is a differential field and 
— {9i, . . . ,9j.} a finite set of unknown parameters, 
which might not be constant. According to Diop & Fliess 
(1991a, b), a parameter 9^, t = 1, . . . ,r, is said to be alge- 
braically (resp. rationally) identifiable if, and only if, it is 
algebraic over (resp. belongs to) ko{u,y): 

• 9i is rationally identifiable if, and only if, it is equal to 
a differential rational function over ko of the variables 
u, y, i.e., to a rational function of u, y and their 
derivatives up to some finite order, with coefficients 
in ko; 

• 9^ is algebraically identifiable if, and only if, it satisfies 
an algebraic equation with coefficients in ko{u,y). 

2.7.3 Determinable variables 

More generally, a variable T G K is said to be rationally 
(resp. algebraically) determinable if, and only if, T^^'^^ be- 
longs to (resp. is algebraic over) A:(mP"''°, yP"''''). A system 
variable x is then said to be rationally (resp. algebraically) 
observable if, and only if, xP"''" belongs to (resp. is alge- 
braic over) fc(^tP"'■^yP"'■<'). 



^^Scc Fliess & Rudolph (1997) for a definition via infinite prolon- 
gations. 

^■^Tlic differential algebraic and the differential geometric languages 
are not equivalent. We cannot therefore hope for a "one-to-one bi- 
jection" between definitions and results which are expressed in those 
two settings. 

■^^Differential algebra has already been employed for parametric 
identifiability and identification but in a different context by several 
authors (see, e.g., Ljung & Glad (1994); Ollivier (1990); Saccomani, 
Audoly & D' Anglo (2003)). 



2.8 Fundamental properties of fault variables'^^ 
2.8.1 Detectability 

The fault variable w^, t = 1,. . . ,q, is said to be detectable 
if, and only if, the field extension W""™), 
where W"°'" = W"°'"\{wf°'"}, is differentially transcen- 
dental. It means that is indeed "influencing" the out- 
put. When considering the variational nominal system, 
formula (6) yields 



nom 
P 



+Tw : 

J __,non 

where T^ e K{s)p^"', Tw e K{s)P'"i. CaU Tw the fault 
transfer matrix. The next result is clear: 

Proposition 2.3. The fault variable is detectable if, 
and only if, the L*^ column of the fault transfer matrix Tw 
is non-zero. 

2.8.2 Isolability, parity equations and residuals 

A subset W' = (wtj , . . . , w^^, ) of the set W of fault vari- 
ables is said to be 



Differentially algebraically isolable if, and only if, the 
extension y""""^, W'""") /k{u^°'^, y""") is dif- 

ferentially algebraic. It means that any component of 
W'"°'" satisfies a parity differential equation, i.e., an 
algebraic differential equations where the coefficients 
belong to y""™). 

Algebraically isolable if, and only if, the extension 
k{u 



nom ynom^ algcbraic. It 



^''See, e.g., Chen & Patton (1999); Blanke, Kirmaert, Lunze & 
Staroswiecki (2003); Gertler (1998); Vaclitsevanos, Lewis, Roemer, 
Hess & Wu (2006) for introductions to this perhaps less well known 
subject. The definitions and properties below are clear-cut extensions 
of their linear comiterparts in Fliess, Join & Sira-Ramirez (2004). 
Some of them might also be seen as a direct consequence of Sec- 
tion 2.7.3. Differential algebra has already been employed but in 
a different context by several authors (see, e.g., Martinez-Gucrra & 
Diop (2004); Martinez-Guerra, Gonzalez-Galan, Luviano-Juarcz & 
Cruz- Victoria (2007); Staroswiecki & Comtet-Varga (2001); Zhang, 
Basseville & Benveniste (1998)). 



means that the parity differential equation is of or- 
der 0, i.e., it is an algebraic equation with coefficients 



nom yiiomX 



• Rationally isolable if, and only if, W'"°™ belongs to 
^^^nom ynom^ It mcans that the parity equation is 
a linear algebraic equation, i.e., any component of 
W'"°™ may be expressed as a rational function over k 
in the variables 2/"^°™ and their derivatives up 

to some finite order. 

The next property is obvious: 

Proposition 2.4. Rational isolability algebraic isola- 
bility differentially algebraic isolability. 

When we will say for short that fault variables are 
isolable, it will mean that they are differentially alge- 
braically isolable. 

Proposition 2.5. Assume that the fault variables belong- 
ing to W' are isolable. Then card( W') < card(y). 



Proof. The differential transcendence degree of the exten- 
sion W'"°'")//c (resp. fc(M"°'", y'i°™)/fc) is 
equal to card(w) -f- card(W^') (resp. is less than or equal 
to card(M) -|- card(t/)). The equality of those two degrees 
implies our result thanks to the Remark 2.1. □ 



3 Derivatives of a noisy signal 
3.1 Polynomial time signals 

Consider the real- valued polynomial function x^it) = 
E^Loa^^'^HO)!!: e R[t], i > 0, of degree AT. Rewrite it 
in the well known notations of operational calculus: 



N 



Xn{s} - 2^ 



v=0 



We know utilize ^ , which is sometimes called the algebraic 
derivative (cf. Mikusinski (1983); Mikusinski & Boehme 
(1987)). Multiply both sides by £^s^+^, a = 0, 1, . . . , iV. 
The quantities a;''^^(0), v = 0,1,..., N are given by the 
triangular system of linear equations^'': 



N 



ds" 



ds° 



(7) 



\v=0 J 

The time derivatives, i.e., s^^^^^, /i = 1, • . • , A'^, < t < 
N , are removed by multiplying both sides of Eq. (7) by 
s-^ , N>N. 

Remark 3.1. Remember (cf. Mikusinski (1983); Mikusin- 
ski & Boehme (1987); Yosida (1984)) that ^ corresponds 
in the time domain to the multiplication by —t. 



^'^ Following Fliess & Sira- Ramirez (2003, 2007), those quantities 
are said to be linearly identifiable. 



3.2 Analytic time signals 

Consider a real-valued analytic time function defined by 

the convergent power series x{t) = where 
<t < p. Introduce its truncated Taylor expansion 



N 



a;(t) = ^x('^)(0)^+O(i^+i) 



(8) 



v=0 



Approximate x{t) in the interval (0, e), < e < p, by its 

truncated Taylor expansion XN{t) = J2v=o ^^"^H^)^ o^" 
der N. Introduce the operational analogue of x{t), i.e., 

^(*) = Eiy>o ^?^Tr^' which is an operationally conver- 
gent series in the sense of Mikusinski (1983); Mikusinski & 
Boehme (1987). Denote by [a;('')(0)]e„ (i), 0<v<N,the 
numerical estimate of x^"^' (0), which is obtained by replac- 
ing Xn{s) by X{s) in Eq. (7). The next result, which is 
elementary from an analytic standpoint, provides a math- 
ematical justification for the computer implementations: 

Proposition 3.1. For <t < s, 

lim[,x('^)(0)],„(i) = lim [xM(0)]e„(t) = X^-HO) (9) 

Proof. Following (8) replace X]y{t) by x{t) = XN{t) -\- 
0(i^+i). The quantity 0{t^+^) becomes negligible if U 
or AT ^ -l-oo. □ 

Remark 3.2. See Mboup, Join & Fliess (2007)) for fun- 
damental theoretical developments. See also Nothen (2007) 
for most fruitful comparisons and discussions. 

3.3 Noisy signals 

Assume that our signals are corrupted by additive noises. 
Those noises are viewed here as highly fluctuating, or os- 
cillatory, phenomena. They may be therefore attenuated 
by low-pass filters, like iterated time integrals. Remember 
that those iterated time integrals do occur in Eq. (7) after 
multiplying both sides by s~^, for TV > large enough. 

Remark 3.3. The estimated value of x{0), which is ob- 
tained along those lines, should be viewed as a denoising of 
the corresponding signal. 

Remark 3.4. See Fliess (2006) for a precise mathemat- 
ical foundation, which is based on nonstandard analysis. 
A highly fluctuating function of zero mean is then defined 
by the following property: its integral over a finite time 
interval is infinitesimal, i.e., "very small". Let us em- 
phasize that this approach?^ , which has been confirmed by 
numerous computer simulations and several laboratory ex- 
periments in control and in signal processings'^ , is inde- 
pendent of any probaMlistic setting. No knowledge of the 
statistical properties of the noises is required. 



■^^This approach applies as well to multiplicative noises (see Fliess 
(2006)). The assumption on the noises being only additive is there- 
fore unnecessary. 

^^For numerical simulations in signal processing, sec Fliess, Join, 
Mboup & Sira-Ramfrez (2004, 2005); Fliess, Join, Mboup & Se- 
doglavic (2005). Some of them are dealing with multiplicative noises. 
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Figure 1: A single link flexible joint manipulator 



4 Feedback and state reconstructor 

4.1 System description 

Consider with Fan & Arcak (2003) the mechanical system, 
depicted in Figure 1. It consists of a DC-motor joined to 
an inverted pendulum through a torsional spring: 

Jmem{t) = n{6i{t) - 6ra{t)) - B9„,it) + KMt) 

JiOi{t) =-K{ei{t)~9,n{t))-mghsm{ei{t)) (10) 
y{t) =6i{t) 

where 

• 9m and 9i represent respectively the angular deviation 
of the motor shaft and the angular position of the 
inverted pendulum, 

• Jm, Ji, h, TO, K, B, Kr and g are physical parameters 
which are assumed to be constant and known. 

System (10), which is linearizable by static state feedback, 
is flat; y = 0; is a flat output. 

4.2 Control design 

Tracking of a given smooth reference trajectory y*{t) = 
9i (t) is achieved via the linearizing feedback controller 



+mgh{ye{t) cos{ye{t)) - (j/e(i))^ sm{ye{t)))] 

+Jiye (t) + mgh sin(2/e (t) ) 

f [Jiyi''\t) + ny,{t) + mghy,{t) cos(ye(t)] 



where 



v{t) ^y*^^Kt)-i4yi'\t)-y<^)it)) 

-isiUt) - y*{t)) - i2{ye{t) - y*{t)) 
-li{ye{t)-y*{t)) 



(11) 



(12) 



The subscript "e" denotes the estimated value. The de- 
sign parameters 71, 74 are chosen so that the resulting 
characteristic polynomial is Hurwitz. 

Remark 4.1. Feedback laws like (11)- (12) depend, as 
usual in flatness-based control (see, e.g., Fliess, Levine, 
Martin & Rouchon (1995, 1999); Sira-Ramirez & Agrawal 
(2004)), on the derivatives of the flat output and not on 
the state variables. 
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Figure 2: Output (-) and reference trajectory (- -) 



4.3 A state reconstructor 



,30 



We might nevertheless be interested in obtaining an esti- 
mate [9„i]e{t) of the unmeasured state 9m{t): 

[9m]e{t) = ^[Jiye{t)+mghsm[ye{t))^ + ye{t) (13) 



4.4 Numerical simulations 

The physical parameters have the same numerical values 
as in Fan & Arcak (2003): J™ = 3.7 x 10"^ kgm^, Ji = 
9.3 X 10-3 kgm^, h ^ 1.5 x 10~^ m, m ^ 0.21 kg, B = 
4.6 X 10-2 m, Kr = 10-^ NmV-~^ . The numerical 
simulations are presented in Figures 2-9. Robustness has 
been tested with an additive white Gaussian noise N(0; 
0.01) on the output y. Note that the off-line estimations 
of y and 0,„, where a "small" delay is allowed, are better 
than the on-line estimation of y. 



5 Parametric identification 
5.1 A rigid body 

Consider the fully actuated rigid body, depicted in Figure 
10, which is given by the Euler equations 



hWi{t) = {h - h)w2(t)w^{t) + Ui{t) 
hMt) = ih - Il)w3{t)wiit) + U2{t) 
hmit) - ih - l2)Wi{t)w2{t) + U^it) 



(14) 



where wi, W2, W3 are the measured angular velocities, ui, 
U2, U3 the applied control input torques, /i, I2, I3 the con- 
stant moments of inertia, which are poorly known. Sys- 
tem (14) is stabilized around the origin, for suitably cho- 
sen design parameters Ai^, Aot, l — 1,2, 3, by the feedback 



''"See Sira- Ramirez & Fliess (2006) and Reger, Mai & Sira-Ramirez 
(2006) for other interesting examples of state reconstructors which 
are applied to chaotically encrypted messages. 
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Figure 5: y: (- -); on-line noise attenuation j/e (-) 
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Figure 6: y (- -); on-line estimation ye (-) 
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Figure 7: 9„i (- -); on-line estimation [9^]^ (-) 




Time (s) 

Figure 8: y (- -); off-line estimation (-) 
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Figure 3: Control 
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Figure 4: Output noise 
proportional-integral (PI) regulators, 



1.2 1.4 



controller, which is an obvious extension of the familiar 



uiit) = 




- l3)'W2{t)w3{t) 


u;i(cr)dcr) 






- \nwi{t) - Aoi 






^ h)w3{t)w,{t) 




+h[ 


- Al2W2(^) - Ao2 




Mt) = 


-ih 


- h)wi{t)w2{t) 






+l3{ 





(15) 




Figure 10: Rigid body 

5.2 Identification of the moments of inertia 

Write Eq. (14) in the following matrix form: 



Wi 




W2W2 


WIW3 






—WIW2 


W1W2 























It yields estimates [Ii]e, [h]^ [l3]e of Ji, I2, I3 when we 
replace wi, W2, w^, wi, W2, W3 by their estimates^^. The 
control law (15) becomes 

Mt) = -i[I-2]e - [h]e)[w2]e{t)[w3]4t) 

+ - \ii[wi]e{t) - Aoi /('[mi]e(cr)dcr^ 

U2{t)= H[h]e - [Il]e)[w:iUt)[wMt) 

+ [l2]e[- Xl2[w2Ut) - X02 Jo[w2Ua)da^ 

M't)= -{[Il]e - [I2]e)[wi]e{t)[w2]e{t) 

+ [I-)]e( - Al3[TO3]e(t) - Ao3 [tos] e (cr)dcr 



5.3 Numerical simulations 
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Figure 13: Feedback stabilization without parametric esti- 
mation 



in fault diagnosis (see, e.g., Blanke, Kinnaert, Lunze & 
Staroswiecki (2003)). 

U 




Xi 



y = X2 



The output measurements are corrupted by an additive 
Gaussian white noise 7V(0; 0.005). Figure 11 shows an ex- 
cellent on-line estimation of the three moments of inertia. 
Set for the design parameters in the controllers (15) and 
(16) Au = 2^m, Aot = tn^, t = 1,2,3, where ^ = 0.707, 
7Z7 — 0.5. The stabilization with the above estimated val- 
ues in Figure 12 is quite better than in Figure 13 where 

the following false values where utihzcd: h = 0.2, h = 0.1 mathematical description is given by 
and I3 = 0.1. 



Figure 14: A two tank system 



6 Fault diagnosis and accommodation 
6.1 A two tank system'^^ 

Consider the cascade arrangement of two identical tank 
systems, shown in Figure 14, which is a popular example 



Xl{t) 

y{t) 



-Vj{t) 



(17) 



A 

X2{t) 



where: 



31 See Remark 3.3. 

''^See Mai, Join & Reger (2007) for another example. 



The constant c and the area A of the tank's bottom 
are known parameters. 
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Figure 11: Zoom on the parametric estimation (-) and real values (- -) 




Figure 12: Feedback stabilization with parametric estimation 



• The perturbation zu{t) is constant but unknown, 

• The actuator failure w(t), < w(t) < 1, is constant 
but unknown. It starts at some unknown time tj >> 
which is not "small". 

• Only the output y = X2 is available for measurement. 

The corresponding pure system, where we are ignoring the 
fault and perturbation variables (cf. Section 2.4.1), 



pure , J_ pure 



ypure = ^.pure 



pure 
2 



is flat. Its flat output is yP"''° = ; 
x^^'^'^ and control variable u^"''® are given by 



The state variable 



pure 



= 2A(-yP"« + ^/^P^)(-j/P"''^ 



c 



(18) 



2Vy 



pure > 



(19) 



6.2 Fault tolerant tracking controller 



It is desired that the output y tracks a given smooth refer- 
ence trajectory y*{t). Rewrite Formulae (18)-(19) by tak- 
ing into account the perturbation variable zu(t) and the 
actuator failure w(t): 



Xl{t) 

uit) 



{^y{t) + VW)Y 



(20) 



1 



(l-w(t)) 

+2A{-y{t) 
c 

i^m + : 



(- 



Am 



With reliable on-line estimates w(f) and ^{t) of the fail- 
ure signal w(t) and of the perturbation vj{t), we design a 
failure accommodating linearizing feedback controller. It 
incorporates a classical robustifying integral action: 



u{t) 



(l-wW) 



- Aw{t) 



+2A(-ye(i) + \/yM) 



,A 



2vW 



+c{-ye{t) + ^yjt)) 
v{t) = y*{t)-Q*{ye{t)-y*{t)) 

This is a generalized proportional integral ( GPI) controller 
(cf. Fliess, Marquez, Delaleau & Sira-Ramirez (2002)) 
where 



• ★ denotes the convolution product, 

• the transfer function of Q is 

A2S^ + Xis + Aq 
s(s + As) 

where Aq, Ai, A2, A3 e M, 

• ye{t) is the on-line denoised estimate of y{t) (cf. Re- 
mark 3.3), 

• ye{t) is the on-line estimated value of y{t). 

6.3 Perturbation and fault estimation 

The estimation of the constant perturbation tu is readily 
accomplished from Eq. (17) before the occurrence of the 
failure w, which starts at time tj >> 0: 

1 



xi{t) = - — ^/x^]fj + —u{t) + ZU ifO<t<ti 

Multiplying both sides by t and integrating by parts 
yields^^ 



{arbitrary < t < e 

^ txi{t)-fo\M<^)-<^{^V^-iuia))]da 



€<t<ti 



where e > is "very small". The estimated value xi{t) 
of xi{t), which is obtained from Formula (20), needs as in 
Section 6.2 the on-line estimation ye{t) and ydt)- 

The estimated value w of w, which is detectable and 
algebraically isolable (cf. Section 2.8.2), follows from 

x(4fc(*) + ^) 

c 2\/ye(t) 
+c{^ye{t) + y/yjrj) - Aw^ 



6.4 Numerical simulations 

Figure 15 shows the closed-loop performance of our tra- 
jectory tracking controller. The simulation scenario is the 

following: 

• The actuator fault w = 0.7 occurs at time tj = 1.5s. 

• We estimate before the unknown constant perturba- 
tion w = 0.2 and use it for estimating w. 

• The fault tolerant control becomes effective at time 
t = 2.5s. 

Robustness is checked via an additive Gaussian white noise 
A''(0;0.01). Comparison between Figures 16 and 15 con- 
firms the efficiency of our fault accommodation. 



■^■^We are adapting here linear techniques stemming from Fliess & 
Sira-Rami'rez (2003, 2007). 
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Figure 16: y*{t) (- -) and y{t) (-) without fault accommo- 
dation 



7 Perturbation attenuation 



7.0.1 Linear case 

Suppose we are given a linear perturbed second order sys- 
tem 

m + y{t) = u{t) - z{t) + Cl{t - ti) (21) 



where 

• z{t) is an unknown perturbation input, 

• is the Heaviside step function, i.e., 

r if t<o 

^> \ 1 if t>0 

• C is an unknown constant and thus C\{t — tj) is a 
constant bias, of unknown amplitude, starting at time 
ti > 0. 

Remark 7.1. The difference Cl{t ^ tj) — z(t) is a ratio- 
nally determinable variable according to Section 2.7.3. 

The estimate Ze{t) of z{t) is given up to a piecewise con- 
stant error by 

Ze{t) - -jjeit) ~ ye{t) + U{t) 

where ye(t) and j/e(i) are the on-line estimated values 
of y{t) and y{t). We design a generahzed-proportional- 
integral (GPI) regulator, in order to track asymptotically 
a given output reference trajectory y*{t), i.e., 

u{t) = y,{t) + z,{t) + y*{t) +g* {y,{t) - y*{t)) (22) 

where 

• is defined via its rational transfer function 

C2S^+C1S + C0 
S(S+C3) 



• + C3S'^ + C2S^ + cis + Co is the characteristic poly- 
nomial of the unperturbed closed-loop system. The 
coefficients cq , ci , C2 , C3 are chosen so that the imagi- 
nary parts of its roots are strictly negative. 

Like usual proportional-integral-derivative (PID) regula- 
tors, this controller is robust with respect to un-modeled 
piecewise constant errors 

The computer simulations were performed with 



is given by 



lOt^ sin(2t) 
1 + 



The unknown constant perturbation suddenly appears at 
time tj = A with a permanent value C — 1.25. The coef- 
ficients of the characteristic polynomial were forced to be 
those of the desired polynomial P(j(s) = (s^ + 2Ct^nS+cj^J^, 
with ( = 0.81, uJn = 4. We have set y*{t) = sin ujt, 
cu = 2.5[rad/s]. 
Figure 17 (resp. 18) shows the reference signal y*{t) and 



Ze{t) = -ye{t) - VeVeit) + uit) 



where ydt), ye{t) a-nd j/e(i) are the estimates of y{t), y{t) 
and y{t). The feedback law (22) becomes 

u^y, {t)y, {t) + Ze [t) +y*{t)+g* {ye (t) - y* (t) ) (24) 

Remark 7.3. Rewrite system (23) via the following state 
variable representation 

Xi{t) = X2{t) 

X2{t) = -Xi{t)x2{t) + U{t) - Z{t) + Cl{t - ti) 
y{t)^Xi{t) 

Applying the feedback law (24) amounts possessing good 
estimates of the two state variables. 

Figures 19 and 20 depict the computer simulations with 
the same numerical conditions as before. The results are 
again excellent. 




Time (s) 

Figure 17: y*{t) (- -) and y{t) (-) without perturbation 
attenuation 

the output signal y(t) without estimating Ze(t) (resp. with 
the estimate Ze{t)). We added in the simulations of Figure 
18 a Gaussian white noise N{0; 0.025) to the measurement 
y(t). The results are quite remarkable. 

Remark 7.2. The same technique yields an efficient solu- 
tion to fault tolerant linear control, which completes Fliess, 
Join & Sira-Ramirez (2004)- Just think at z(t) as a fault 
variable. 

7.0.2 Non-linear extension 

Replace the term y(t) in system (21) by the product 

y{t)m- 

y{t) + y{t)y{t) = u{t) - z{t) + Cl{t - ti) (23) 

The perturbations z{t) and Cl(t — t/) are the same as 
above. The estimate Ze{t) of z{t) up to a piecewise constant 




Time (s) 

Figure 19: y*{t) (- -) and y{t) (-) without perturbation 
attenuation 



8 Conclusion 



We have proposed a new approach to non-linear estima- 
tion, which is not of asymptotic nature and does not 
necessitate any statistical knowledge of the corrupting 
noises^*. Promising results have already been obtained, 
which will be supplemented in a near future by other theo- 
retical advances (see, e.g., Barbot, Fliess & Floquet (2007) 
on observers with unknown inputs) and several concrete 
case-studies (see already Garcia- Rodriguez & Sira- Ramirez 
(2005); Nothen (2007)). Further numerical improvements 

•^■^Let us refer to a recent book by Smolin (2006), which contains 
an exciting description of the competition between various theories 
in today's physics. Similar studies do not seem to exist in control. 
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Figure 18: y*{t) (- -) and y{t) {-) with perturbation attenuation 



will also be investigated (see already Mboup, Join & Fliess 
(2007)). 
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